Fluctuation theorems for quantum processes 
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We present fluctuation theorems and moment generating function equalities for generalized ther- 
modynamic observables and quantum dynamics described by completely positive trace preserving 
(CPTP) maps, with and without feedback control. Our results include the quantum Jarzynski 
equality and Crooks fluctuation theorem, and clarify the special role played by the thermodynamic 
work and thermal equilibrium states in previous studies. We show that for projective measurements 
unitality replaces micro-reversibility as the condition for the physicality of the reverse process in 
our fluctuation theorems. We present an experimental application of our theory to the problem 
of extracting the system-bath coupling magnitude, which we do for a system of pairs of coupled 
superconducting flux qubits undergoing quantum annealing. 



Introduction. — Fluctuation theorems provide powerful 
analytical tools for noncquilibrium physics. Some 15 
years ago Jarzynski discovered an equality for classi- 
cal processes that shows how to determine free energy 
changes by measuring only the work performed on the 
system, without the need to determine the accompany- 
ing entropy changes, and in particular without the re- 
quirement that the processes be quasistatic. The classical 
Jarzynski equality (CJE) pQ 

(e _ p(u ,_ AF))=7j (1) 

where 7=1, relates the statistical average () of the 
work w done on a driven system to the free energy dif- 
ference AF of the final equilibrium state (whether this 
state is reached or not) and the initial thermal equilib- 
rium (Gibbs) state, at fixed inverse temperature (3. In 
the presence of feedback control ("Maxwell's demon") 
the efficacy parameter 7 differs from unity, and charac- 
terizes the efficacy of feedback and the amount of infor- 
mation extracted [2] . The CJE follows directly from the 
Tasaki-Crooks fluctuation theorem 0], which relates 
the probability density function (PDF) of work done in 
the forward process Pp (w) to the PDF of a reverse pro- 
cess Pr(w): 

P F (w)e~^ w ~ AF ^ = Pr(-w) . (2) 

Many generalizations have been developed (for reviews 
see, e.g., [MZ])- In particular, the classical results (see 
also [8]) have been quantized, first for thermal states 
undergoing unitary evolution [4], and subsequently for 
thermal states undergoing non-unitary, open system dy- 
namics [5Ml 7). including continuous monitoring |18) and 
quantum feedback [21 115 1 120 ] . 

Here we aim to show that there exists a single unified 
framework from which all these results can be derived as 
well as generalized, using only basic tools of the theory 
of open quantum systems |21j and quantum information 



theory 22J. To this end we derive a general fluctuation 
theorem for quantum processes described by completely 
positive trace-preserving (CPTP) maps £ , with or with- 
out feedback. Our strategy for doing so leads to a general 
and simple recipe for writing down fluctuation theorems, 
not all of which must correspond to a measurable thermo- 
dynamic observable or involve a physical reverse process. 
We show that in order for a PDF for the reverse process 
to exist, the map £ must be unital. In this sense unital 
channels emerge as playing a crucial role in fluctuation 
theory, replacing the standard thermodynamic notion of 
micro-reversibility. Our work illuminates the special role 
played by the Gibbs state and work measurements, both 
of which feature prominently in the literature on fluctu- 
ation theorems. 

We test and confirm our theory via an experiment in- 
volving pairs of superconducting flux qubits on a pro- 
grammable chip, allowing us to empirically determine 
the first moment of our integral fluctuation theorem. 
We show that these experimental results can be well ex- 
plained using a time-dependent Markovian master equa- 
tion with a free adjustable parameter determining the 
system-bath coupling strength. As a novel application, 
our theory allows us to determine this parameter by fit- 
ting to the experimental data. We thus establish quan- 
tum fluctuation theorems as important tools for studying 
open quantum systems. 

General Fluctuation Theorem. — Consider a fiducial ini- 
tial state p, two sets of generalized measurements V := 
{P a } and Q := {Qp} (see also [2D]), a CPTP map £ 
(see also [23]), and a fixed, yet arbitrary distribution 
q := {qp}. The quintuple (p,V,£, Q,q) is the basic in- 
put data describing the problem. The measurement op- 
erators P a satisfy ^2 a P^P a = 1 (the identity operator), 
and similarly for Q. The CPTP map £ has Kraus oper- 
ators {At}, i.e., £{X) = £. A l XA\, where J2i A A i = 1 

We first consider the forward process depicted in 
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FIG. 1. The forward process protocol. A quantum state p 
is prepared, measured {V), evolved via a CPTP map £, and 
measured again (Q). The final state pf thus obtained is in 
general different from the virtual final state p q . 



Fig. [T] A mixed state ensemble p p = ^2 a p a p a is pre- 
pared by measuring V, so that the normalized state 
Pa = PapPl/Pa has probability p a = Tr[P^P a p]. Next 
p a evolves under £, and finally the measurement Q is 
performed. The conditional probability of observing out- 
come (3 given outcome a is then pp\ a = Tr[Q\Q p£(p a )]- 
The marginal probability distribution of outcomes is 

/ : = {/a}i where fp = Y, a Pp\aPa = Y, a P(a,P), and 

where P( a ,p) is the joint probability distribution. 

We next define the (virtual) final state p q := 

QpQp > is a normal- 



2/9=i 1P°~P j where op 

ized state having probability qp > V/3. Note that 
d = Tr[l] is the system Hilbert space dimension and 
that fp = Tr [up £(p p )]. Let the random variable V be 
a real-valued function parametrized by the measurement 
outcomes {a,/3}. V will play the role of a generalized 
thermodynamic observable [35]. Its PDF is 



Pe(v) ■= ^2 S(v ~ V a p)p (a 



P) 



= y~]6(v- V a p)Tr[<jp£(p a )]p a 



(3a) 



(3b) 



Let us now choose V a p = \n{p a /qp) (this choice is 
by no means unique |26j). and also define the general- 
ized reverse thermodynamic observable Vp a := —V a p = 
\n(qp/p a ). Then, using the Dirac delta properties 5{x — 
xo)f(x) — 5(x — xo)f{xo), and 5{x) = 8(—x), we find 



Pe(v)e~ v = J2 S ( y - V a p)Ti[ap£(p a )]qp 



(4a) 



a,P 



= J2$(-v-Vp a )Tr[p a £*(ap)]qp , (4b) 

a,P 

where we used the dual map £ * with Kraus operators 
{A*}, i.e., £*{X) = ^AlXAi, for which Tv[A£{B)} = 
Tr[B£* (A)] for any pair of operators A and B. 



Comparing Eqs. (3b) and (4b) we see that the latter 



can be identified with P £ *(— v). We have therefore ar- 
rived at our fluctuation theorem for CPTP maps: 



P £ (v)e- V = P £ ,(-v) 



(5) 



Note the obvious similarity to the Tasaki-Crooks fluctu- 
ation theorem, Eq. 



We define the efficacy 7 [51 [53] as 

/OO 
dvP £ .(v) =^Tr[p (? f(p ce )] =J2 r R[p*£*(p q )} ■ 
-°° a a 

(6) 

Note that P £ * need not be a probability distribution (it 
is not necessarily normalized) . Upon integration, our de- 
tailed fluctuation theorem gives an integral fluctuation 
theorem, which we call the quantum Jarzynski equality 
(QJE), as it generalizes the CJE, Eq. ([I]): 



dvP £ (v)e~ v = 7 



(7) 



Using Jensen's inequality we have (e^) > and thus 
find a generalized 2nd law of thermodynamics (we clarify 
this claim below) [27] : 



(v) > — In 7 



(8) 



We can substantially generalize the QJE Eq. ^ in 
terms of the moment generating functions for the map £ 
and its dual, 



Xe(X)~ dvP £ (v)e M , xe*W ■= / dvP £ *(v)e Av . 

• ' — OO J — OO 

(9) 

We then find after some calculation [28 our central re- 
sult: 



X£(A-1)=X£«(-A) , 



(10) 



It extends the integral fluctuation relation Eq. ^ to all 
moments of the PDF P £ (v). For example, setting A = 0, 
we recover the QJE Eq. @: xe(~l) = (e~ v ) = Xs*(0) = 
7- 

Moreover, using (v) = j^Xs M| A _ we nnc ^ 

(v) =H(f\\q)+H(f)-H(p) , (11) 

where H(f\\q) = ~Y,p fp^Qp) - H (f) is the Na- 
tive entropy (Kullback-Leibler divergence), and H(f) = 
— fp Iv-(fp) is the Shannon entropy. 

Projective measurements. — An important special case 
arises when the measurements V and Q are projective 
and when moreover we prepare p p = ^2 a p a Pa and let 
Pq = J2plpQp, with {P a } and {Qp} rank-1 projec- 
tors (pure states). For V a p = hi(p a /qp), we obtain 
7 = Tr[pg£(l)} = Tr[£*(p q )] (see also [2J). In this 
case, P £ * is a probability distribution if £* is itself a CP 
map, i.e., £ is unital [£ (1) = 1] . If it is unital then 
7 = 1 .215], and we can interpret P £ *(v) as the probabil- 
ity density associated with the following reverse process: 
i) prepare the state p q = ^2pqpQp, ii) measure Q, iii) 
evolve via £*, iv) measure V. Thus unitality replaces 
micro-reversibility. Why are unital channels singled out? 
Whereas classical micro-reversibility imposes a specific 
relation between forward and time-reversed phase space 
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FIG. 2. Distance-entropy diagram illustrating the generalized 
2nd law of thermodynamics (see text for details). 



paths [3] , a unique and suggestive feature of unital chan- 
nels is that they can always be written as an affine com- 
bination of reversible channels, i.e., £{p) = J2j u jUj P Uj, 
where Uj is unitary, Uj € K and 52 ■ Uj = 1 [30] , 
Using Eq. @, we then obtain 



Xe(X) 
and consequently: 



Tr[^(p p A+1 )] , 



(12) 



the 2nd law in the Clausius form AS qp > (3Q. This clar- 
ifies why Eq. pi) can be interpreted as a generalized 2nd 
law of thermodynamics. 

Including feedback. — Suppose we repeat the forward 
protocol of Fig.[T]in the projective measurement case, but 
denote the CPTP map by £ and the final measurement 
by Q = {Qj}. Depending on the measurement outcome 
j, we apply an additional CP map £j to the resulting 
state Qj . This constitutes a feedback step, and general- 
izes earlier work which considered only unitary feedback 
maps [H ES [5U] ■ Next we apply another projective mea- 
surement Q'j = {Qp\j}, labeled by the outcomes f3. Thus 
£ from Fig. [I] is replaced by £j := £ ) o Q o £ , and Q by 
Q'y Given an initial state P a , the probability of observ- 
ing outcomes j and (3 is P(j t p)\ a = Tr \Qp\j£j(P a )], and 
the joint distribution is p^aj.p) = P(j.p)\ a Pa- As in the 
feedback-free case, we can construct the PDF associated 
with the generalized thermodynamic observable V as: 



PS ■= ^ ~ Vajl3)P(c 



(14a) 



J2 6 ( V - V*Jfi)T*[Qfi\&(Pa)]Pa > (Wb) 



(v) = S(£( Pp )) - S(p p ) + S(£(p p )\\ Pq ) (13a) 
= S( Pq ) - S( Pp ) + Tr{(p q - £{ Pp )) \n{ Pq )\ , (13b) 

where the quantum relative entropy S (p\\a) — 
— Tr[plncr] — S(p), and S(p) = — Tr[p\np] is the von 
Neumann entropy. This generalizes the result for the 
mean irreversible entropy production of Refs. (3TJ |35] . If 
S(£(p p )) — S(p p ) (e.g., when £ is unitary) then (v) — 
S (£{p p )\\p q ). If p q is £ -invariant [£{p q ) = p q \ and £ is 
unitary (as in a quantum quench), then (v) = S (p p \\p q ). 
If £(p p ) = p q then (v) = S(p q ) - S(p p ) [33]. 



Eq. ( 13 ) has an interesting interpretation, illustrated 
in Fig.]2f Referring first to Eq. (13a), side (1) of the 
triangle represents the von Neumann entropy change 

(1) := S(£(p p )) — S(p p ) occurring in the physical pro- 
cess enacted by £, while side (2) is an information- 
geometric measure of the distance (2) :— S(£(p p )\\p q ) 
between the evolved state £(p p ) and the "virtual" one 
p q [33]. On the other hand, referring to Eq. (13b), side 

(2) can also represent (2') := Tr[(p 9 — £ (p p )) \n(p q )] < 
\\£ (p p ) — p q \\i\ h^min^ qp)\, which is again related to the 
information-theoretic distance between the evolved and 
virtual state. Side (3) represent the von Neumann en- 
tropy change, i.e., (3) := S{p q ) - S(p p ). 

In the thermal case p p — e~^ Hi /Zi and p q = 
e~P H f jZf (where -ffi// is the initial/final Hamiltonian) , 
we find (2') = ^\n f £ (p p )] - Tr[H fPq ]) =: -(3Q. 
Here Q represents the heat exchange in the (virtual) un- 
driven relaxation between the evolved and virtual states, 
£(p p ) i — ^ p q . In the thermal case (3) amounts to a ther- 
modynamical entropy change AS qp . Thus in this case, 
using Eq. (18]) and assuming unitality (7 = 1), we have 



where the notation Pg (Ps*) is shorthand for P{e j } 
{P{£*})- We now choose V aj/3 = In (p a /qp\j) = -Vpj a , 
where qj := {qp\j} is an arbitrary, fixed distribution, 
associated with the (virtual) state p q \j := J2/3<ll3\jQf3\j- 
Then 



P £ (v)e- 



^2 6 (-v ~ Vp ja )TT[P a £*(Q Plj )}q Pl:j 



P £ .(-V) 



(15a) 
(15b) 



Integrating, we find a generalized integral fluctuation the- 
orem in the presence of feedback: 

(e- v ) =Y,^\Mn = E Tr [ f ; M] = : 7 • (is) 



Generalizing Eqs. ( 10 ) and ( 12 ), we find the moment gen- 



crating function for the feedback case 



Xf(A-l) 



qU %(Pp) =X£-(-A). (17) 



We show in [28] how these results allow us to recover 
known quantum fluctuation theorems with feedback [35j . 

Experimental application of the open-system QJE. — 
Compared to the classical case (e.g., [3SHH]), there has 
been relatively little work on experimental tests or appli- 
cations of the quantum version of the Jarzysnki-Crooks 
relations [12] . We now present an application of our gen- 
eralized QJE [Eq. Q] to the problem of extracting the 
system-bath coupling magnitude, using both numerical 



4 



The 



simulations and an experiment with a quantum annealing 
chip comprising superconducting flux qubits (for experi- 
mental details see PHI)- The qubits are described by the 
tranverse-field Ising Hamiltonian Hg(t) = —A(t) ^ af + 
B(t)Hi sing , where Hj sing = - £\ =1 he* ~ ^2i<j 
and where the cr's are standard Pauli operators 
magnetic fields hi and couplings (superconducting induc- 
tances) Jij are programmable. This open system can 
be described by an adiabatic Markovian master equa- 
tion [13] derived in Ref. @3] (see [25] for essential de- 
tails). The annealing functions A(t) and B(t) satisfy 
A(0),B(t f ) ^ 0, A(t f ),B(0) = 0, where t f is the to- 
tal annealing time. The CPTP map £ is the one gen- 
erated by the master equation and is not unital |28j . 
We consider projective measurements that prepare p a = 
e -P £ «(°)/Z(0), q = e-P^M /Z(t f ), where £ a ,p(t) are 
the instantaneous eigenenergies of H$ (t) , so that our gen- 
eralized thermodynamic observable V a p = ln(p a /g«) is 
given by V a p = (3(^(t/) - e a (0)) - |3(F(t/) - F(0)), 
where the free energy F = — ln(Z)/(3. Note that for an 
open quantum system, ep(tf)—e a (Q) does not correspond 
to the work done on the system. Equations (|6j) and Q 
yield 



<i> 



-P(AB-AF) 



) = 7 = Tr[f*(p G (i / ))] , (18) 



where pc(^) = exp(— $Hs(t))/Z(t) denotes the Gibbs 
state associated with H$(t), with p p = pc(0) and p q = 
Pg(^/)j AF is a random variable taking values in the 
set {ep(t f ) - £ Q (0)}, and AF := F(t f ) - F(0). Equa- 
tion ( |13a[ ) gives: 



$((AE)-AF)=S(p(t f )\\p G (t f )) 
-S(pg(0)) , 



W/)) 



(19) 



where we have denoted p(i/) = £(pc(0)). 

For concreteness we consider a two-qubit system with 
-falsing = — 5X^=1 °f ~ J°~\ a 2- We checked the equal- 



ity expressed in Eq. (18 1 by independently numerically 



simulating its two sides for this model using our mas- 
ter equation, and find essentially perfect agreement. The 
same holds for Eq. (|13a|) [35]. We tested the same two- 



qubit system experimentally. The system was initialized 
in the Gibbs state (at T = 17mK) and we measured 
the occupancy of each final energy eigenstate (of -fusing), 
repeating the quantum annealing process thousands of 
times. The empirical relative occupancy corresponds di- 
rectly to the probability fp of measuring energy ep(tf). 
Therefore, this allows us to experimentally determine 
(e(tf)) = Yl,a e p(tf)fp- We also know (e(0)) from the 
initial Gibbs state and the value of A(0). We thus deter- 
mine 

(v) = p^M^-e^CO-AF)^) 

a,/3 

= fi ((e(t f )) ( £ (0)> - AF) , (20) 
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FIG. 3. Experimental results (blue dots with error bars) 
for (v) [from Eq. ( 20 1] and the best fit using the adiabatic 
Markovian master equation (red x ) with the extracted value 
k = 1.83X10" 3 . Main panel: as a function of J, with tf = 5 /is 
in both the numerical simulations and the experiment. Inset: 
as a function of tf, with J = 1/2 in both the numerical sim- 
ulations and the experiment. 



where we compute AF using exact diagonalization |28j . 
We show these results in Fig. [3] as a function of tf and 
ferromagnetic coupling strength J. Our master equation 
has two free parameters: the high-frequency cut-off w c , 
which we set to 8-7T [44], and the system-bath coupling 
magnitude k — g 2 ri/h 2 , where g is the system-bath cou- 
pling constant and r\ characterizes the Ohmic bath [28] , 
Remarkably, by simultaneously minimizing the deviation 
between the numerical solution of our master equation 
and the experimental data for (v) as a function of J and 
tf allowed us to extract the system-bath coupling mag- 
nitude K from Eq. (j20j) [2"g] . 

Why does (v) display a minimum as a function of J 
(main panel of Fig. [3])? In our experiment (3A(0) ~ 
fiB(tf) w 15, so that the Gibbs state is almost pure, 
i.e., both S(p G (0)) and S(p G (t f )) < 1. Therefore we 
are effectively measuring the information-theoretic dis- 
tance S (p(tf)\\pQ(tf)). Increasing J at fixed tempera- 



ture kT — 1/ 13 is like decreasing T while fixing J. Thus 
the system requires more time to equilibrate as J grows, 
but we keep tf fixed. On the other hand, as J becomes 
very small the ground and first excited states become 
degenerate, so the excitation probability increases, and 
the system is again farther from equilibrium. Also, as 
we increase the annealing time, p(tf) becomes closer to 
the Gibbs state, causing S (p(tf)\\pG(tf)) to decrease as 
observed in the inset. 

Conclusions. — We presented fluctuation theorems and 
moment generating functions for CPTP maps, thus gen- 
eralizing previous work on the Jarzynski-Crooks relations 
and the 2nd law for open quantum systems, including 
processes with feedback. We performed an experiment 
using superconducting flux qubits that matches the fluc- 
tuation theorem protocols, and used this experiment to 
extract the system-bath coupling for an adiabatic Marko- 



5 



vian master equation that nicely matches the experimen- 
tal results. Our work ties together key ideas from statis- 
tical mechanics, quantum information theory, and the 
theory of open quantum systems, and paves the way to 
experimental tests and applications of fluctuation theo- 
rems in the most general setting of open quantum system 
dynamics. 
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Supplemental Material for "Fluctuation 
theorems for quantum processes" 

To distinguish main text equation numbers from equa- 
tion numbers in this Supplemental Material, we denote 
equation number x from the main text by "Eq.M. (x)" , 
while equation numbers cross-referenced in the Supple- 
mental Material are denoted by the usual "Eq. (x)" . 



DERIVATION OF EQ.M. (10) AND EQ.M. (12) 

Using Eq.M. (3b) and Eq.M. (9) we have 



XeW ■= / dvP £ (v)e Xv (la) 

J — oo 

/oo 
dVe XV ^ S ( V ~ V {a,f3})Tr[(Tf3£(p a )]p a 



a, p 



^2(Pa/q(s) X Tr [(Tp£(j) a )] p 

4e^ + v)e^- 



= Tr 



(lb) 
(lc) 

(Id) 



so that 



X5(A-l)=Tr 



= Tr 



^(e^Ie^ 

V a J 13 



(2a) 
(2b) 



On the other hand, using Eq.M. (4b) and Eq.M. (9) we 
have 



X5*(-A)= / dvP £ ,{v)e- x " (3a) 

J — OO 

= f° dve~ Xv Y, S (v - V { p !a} )Tr[p a £*(ap)]qp 

J —OO „. a 



a,P 



E (p«/?/3) a Tr [p<x£*{op)] qp 



Tr 



<T/3 



Xf(A-l) 



(3b) 
(3c) 

(3d) 
(3e) 



In the case of projective measurements and and when 

Pv = HaPaPa-, Pq = Sfl IpQPl with { P a} and {Q p} 

rank-1 projectors, Eq. (TTdfc directly becomes Eq.M. (12). 



DERIVATION OF THE ENTROPY FORMULAS 

FOR (v) 

Generalized measurements: Eq.M. (11) 

We prove Eq.M. (11) from the first moment expression 



x=o 



Then, using Eq. ( Id I 



{v) = Tx Tr 



Tr 



^E^ + v«)e^ 

£ (E^ +lln (PaKJ E^ V / 
V a ) p 

£ (E^ + Va)E^ Aln fe) 

V a 7/3 



(4a) 



A=0 



A=0 



(4b) 



Tr 



£ E Pq m (P")Po 



Tr 



E Pq ln (P") _ E ^ lll ( <? ' 3 ) ' 



(4c) 
(4d) 



where to arrive at Eq. (4c) we used the fact that 



Hp a P = Y,pQpQp = to arrive at Eq. (Hdj) 



that £ is trace-preserving and Tr[p Q ] = 1, and ob- 
served that Ti[ap£(p p )} = Tr QpQp£(Z2 a Papa) = 

T, a Tr [QpQp £ (P<x)]P°' = J2 a Pp\aPa = fp- Adding and 
subtracting H(f) = — J2pfp^ n (fp) we thus arrive at 
Eq.M. (11). 



Projective measurements: Eq.M. (13) 

Next we prove Eq.M. (13a) using a similar technique. 
Starting from Eq.M. (12) we have 



A=0 



Tr [p~ x £ (p x+1 Info,)) - p~ x ln(p q )£ (p x p +1 )] 

Tv[£ (p p ]n(p p ))]-Tr[]n(p q )£(p p )] 
S(£(p p )\\p q ) + S(£(p p ))-S( Pp ) , 



(5a) 

(5b) 
(5c) 
(5d) 



where to arrive at Eq. (5dl we used the fact that £ is 



trace-preserving, and added and subtracted S {£ (p P ))- 
Finally, Eq.M. (13b) amounts to the following calcula- 



tion, starting from Eq. ( 5c I : 



Tr [£ (p p ln(p p ))] - Tr [\n(p q )£ (p p )} (6a) 

= S(p q ) + Tr [p p ln(p p )} - Tr [ln(p q )£ (p p )] - S(p q ) 

(6b) 

= S(pg)- S(p p ) + Tr[(p q -£{p p )) In p q ] ■ (6c) 



The heat term 



In the main text we claimed that in the thermal case, 
when p q = e~P H f/Zf (where Hf is the final Hamilto- 
nian), we find (2') := Tr[{p q - £{p p ))\n{p q )] = -0Q. 
Here is the proof: 



Tr[{p q - £(p p ))ln(p q )} 

= -Trl(p q -£(p p ))(VH f +]nZ f )} 
= V(Tr[H f £(p p )]-Tr[H f p q ]) 
= H(Hf) £(pp) -(H f ) Pq ) , 



(7a) 
(7b) 
(7c) 
(7d) 



where to arrive at Eq. (7c) we used Tr[£ (p p ) In Zf] = 
In Zf since £ is trace-preserving, and Tr[p 9 In Zf] = In Zf. 
Since the (virtual) relaxation process from the state £{p p ) 
to the state p q is undriven (i.e., there is no work involved), 
the internal energy change expressed in Eq. ( 7d I is a pure 
heat exchange. 



DERIVATION OF EQ.M. (17) 

Using Eq.M. (9) and Eq.M. (14b), we have 

/OO 
dvP e (v)e Xv (8a) 
-OO 

/OO 
dve Xv <*(« - Vvjftfk [Q^EjiPe,)] Po, 
-OO _ a 



= E (Pa/g/3|j) A Tr [QfljSjiPa)] Pa 



E Tr 



\ a //3 



E T 4^ +1 ) 



4 



so that 



Xs 



(x-i) = Y^[eAp x p )pIu 

3 

=EM^;(4 > 



(8b) 
(8c) 

(8d) 
(8e) 

(9a) 
(9b) 



On the other hand, using Eq.M. (9) and Eq.M. (15b), we 
have: 



Xfi.(-A) = / dvP £ ,{v)e- Xv (10a) 

J —OO 

/OO 
dv Y s i v ~ yaja) Tr [ p »£j (Qp\j)] 
-OO „. • a 



= E Tr 



em^(4 a ; 



which is the result in Eq.M. (17). 



(10b) 
(10c) 

(lOd) 

(lOe) 
(lOf) 



RECOVERING KNOWN FLUCTUATION 
THEOREMS 

In order to recover the well-established closed system 
results [4|, we consider the CPTP map £ to be simply 
the unitary evolution: 



£{X) = U(t f ,0)XU\t f ,0) 



(11) 



Since this map is unital, its dual is also a CPTP map 
(the actual time reversed process) given by: 



£*(X) = uHt f ,0)XU(t f ,0) , 



(12) 



where t/(t/,0) = T + cxp(— i J Q f H(t)dt), and the Hamil- 
tonian H{t) has instantaneous eigenenergies e(t). Using 
Eq.M. (6) this yields 7 = 1. 

Recall that in our formalism we need to also specify the 
fiducial initial state p, the measurements V and Q, and 
the distribution q. We pick these so that they generate 
the Gibbs distributions 



Pa 



-p Sct (0) 

~zW~ 



-(3e/3(*/) 



(13) 



at inverse temperature |3, where Z(t) = Tr[exp(— |3iJ(i)] 
is the partition function corresponding to Hit), and 
pG{t) = exp(— $H(t))/Z(t) is the corresponding Gibbs 
state. For example, we can assume that p = pq(0), 
V = {M0))(e Q (0)|, and Q = {Mt/))M*/)I}- 

If we let V{ a / 3j = \a{p a /qp) this then corresponds to 
the choice: 

V {a , n = P( e/J (t/) - e a (Q)) - HF(tf) ~ HO)) , (14) 

where F is the free energy given by F(t) = — In Z(t)/fi. 
This corresponds to identifying v with the (dimension- 
less) work. 
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FIG. 4. The feedback protocol associated with the forward 
process with an intermediate measurement whose result in- 
troduces the conditional CP map £j. 



We thus find from Eq.M. (7) the QJE for a closed quan- 
tum system: 



; -P(AiS-AF)N = 1 



(15) 



where AE is a random variable taking values in the set 
{ep(t f ) - e Q (0)}, and AF := F(t f ) - F(0). For these 
choices, Eq.M. (13a) becomes 

P ((AE) - AF) = S (£( PG (0))\\ PG (t f )) , (16) 

where we have used S(£(pc(0)) = S(pg(0))- For a 
closed quantum system, the heat transfer in and out 
of the system is zero, so AE is equal to the work w. 
Furthermore, for a closed quantum system, the relative 
entropy S (£ (pg(0))||pg(*/)) is equal to the mean irre- 
versible entropy production (ASi rr ) [HI [3T], so we can 
rewrite Eq. dl6|) as 



(3 ((w) - AF) = (AS- n 



(17) 



which is the 2nd law of thermodynamics, since (ASi rr ) > 
0. 

As this example illustrates, our formalism clarifies the 
subtle relationship between the choice of the thermody- 
namic observable V{ a ^, the initial state probability p ai 
and the dual reverse state probability qp , which together 
comprise the Jarzynski equality and lead to the 2nd law. 



RECOVERING KNOWN FEEDBACK CONTROL 
RESULTS 



Our generalized feedback control protocol is illustrated 
in Fig.gJ 

We can recover known feedback control cases [2J [2U] 
as follows. Assume that the evolution is unitary and the 
intermediate measurement is error-free. In this case, the 
jth CP map is given by 



£ j (X) = U j Q j UXU^Q j U j 



This leads via Eq.M. (16) to 

3 3 

E Tr /^Ow^ 



(19) 



If we now pick the fiducial initial state p, the measure- 
ments V and Q'p and the distribution qj so that they 
generate the Gibbs distributions 



-p4 



Pa 



(20) 



e 

Z(0) ' q M = ZJltT) ' 

where p q \j — exp(—{$Hj(tf))/Zj(tf) is the Gibbs state 
associated with Hj(tf), then we recover the result for 7 
derived in Ref. [2U]. 

We next consider the case of a classical measurement 
error. In this scenario when a projection on j is made, 
there is a measurement error that gives j' with proba- 
bility Pj'tj, so that the feedback operation applies Uj> 
instead of Uj. The CP map is then given by: 



£ r (X) = Y.i'rJyQJXl'Qj: 



(21) 



Choosing the same p and q distributions as in Eq. ( 20 ) 
with j replaced by f, results in 

7 = E Tl ' [P1\3' £ 3'W] = E'V • IV \Pq\3 lU 3'Q3 U l 
3' 3,f 

= Y,Pr\i 1± [Qi U i'P<i\i' u i'Q>] ' ( 22 ) 
3,3' 

which is again exactly the result for 7 derived in Ref. [2U] . 

We are free to choose a different generalized thermo- 
dynamic observable: 

V ajr0 = In (p a /qfs\j>) + I]]' =■ -Vpj'ja , (23) 



(18) 



where 

I n , := In (p rU /p r ) , (24) 

the mean of which is the classical mutual information. 
Note that 

Eft'^U' = 1 • ( 25 ) 

0,3' 

The joint distribution can be decomposed us- 
ing Bayes' rule as P( a ,j,j',0) = PaP(j,j',f3)\ a , 
where the conditional probability is P(jj',f})\ a = 

P3'\jT* [QdU'UfQjUPaWQjU], . 

We then have 
P{s j ,}{v)= E S ( v ~ V <*i3'P)P(.«,3J',P) ( 26a ) 

x Tr [rfQjUlQwUyQjUPc,] , (26b) 
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so that 

P{S 3 ,}{v)e- v = S (- v -Vpj'ja)qi3\j>Pj> 

xTt[rfQ j U},Q fl \ j ,U j >Q j UP a ] . (27) 
Note that the quantity 

Y,Pi'mr u }>Q?\r u i> =--p (28) 

0,3' 

is a density matrix. We can define a CPTP map: 



£{p) = C/t 



E QjpQo 



u 



(29) 



We thus recover the integrated fluctuation theorem: 

f dvP E {v)e- v =Y,^[PJ{f>) 

= Tr [i (p)] = 1 , (30) 
which is again the result in Ref. [20] . 



DETAILS ABOUT THE MASTER EQUATION 

The underlying model assumes a total Hamiltonian of 
the form H(t) = H s (t) + H B + Hj, where H B is the 
bath Hamiltonian and Hj is the system-bath interaction. 
We consider a simple harmonic oscillator bath H B = 
w/c&^b/e, with the interaction given by the standard 

dephasing model [54], Hi — g £\ of ® £ fc (^fe + • 

The master equation used in our simulations is derived 
in Ref. [U] and is given by (in units of H = 1) : 

psit) = -i [H s (t) + H LS (t), Ps (t)} + J2 7H 

x (z w (i)p s (t)4(t) _ 1 {4(t)Z w (f),p s (f)}) (31) 

where i?LS is the Lamb shift, the 7's are dephasing and 
relaxation/excitation rates. The Lindblad operators are 
given by: 

m*) = E k-(i)>(e.(*)iE°<i e »W)< e »wi - 

w=eb(t)-£ (t) * 

(32) 

where the instantaneous Bohr frequency u is expressed 
in terms of the instantaneous energy eigenstates, i.e., 
Hs(t)\e a (t)) = e a {t)\e a (t)) For an Ohmic bath with high- 
frequency cut-off ui c , we have 

ff LS =^5(o;)Lt(t)L a; (t) , 



3.0 
2.5 
2.0 
1.5 
1.0 
0.5 




0.0 0.2 0.4 0.6 0.8 1.0 1.2 



0.2 0.4 0.6 0.8 1.0 1.2 



^xlO 3 
fi 2 



FIG. 5. Independent calculation of ( e -P(AE-AF)^ ^ lue soM ^ 
and 7 (red dashed) as a function of the system-bath coupling 
strength using the adiabatic Markovian master equation with 
tf — 5/j.s, J — 1/2, T — 17mK, and u c — 8n. Inset: magni- 
fication of the behavior near the top of the curves. The two 
curves overlap to within numerical accuracy. 



where 77 is a parameter (with dimension time squared) 
characterizing the Ohmic bath, and V denotes the 
Cauchy principal value. To see that this CP map is not 



unital, we plug 1 into the RHS of Eq. (31 1 and find that 



the non-zero component arises from the dissipative part 
associated with relaxation and excitation processes 



EtH [M*),4(*)] 



(34) 



Since 7(w) 7^ j(— u)), meaning that the relaxation and 



excitation transition rates are unequal, the term ( 34 1 is 



non-zero, making the CPTP map generated by the mas- 
ter equation non-unital. 



NUMERICAL CONFIRMATION OF THE QJE 
AND FIRST MOMENT EXPRESSION FOR THE 
ADIABATIC MARKOVIAN MASTER 
EQUATION 

In order to test Eq.M. (18) and Eq.M. (13a) we per- 
formed the following simulations for the two-qubit model 
described in the main text. We initialized the system in 
one of the four energy eigenstates, ps(0) — |e a (0))(e a (0)|, 
then we evolved the density matrix using our adiabatic 
master equation. The diagonal elements of the density 
matrix at t = tf are then associated with the probability 
Pp\ a of measuring the state \sp(tf)}. Using this we calcu- 
lated the expectation value (e~P( AE ~ AF )). We then used 
our adiabatic master equation to evolve the identity op- 
erator. This allowed us to numerically find £ (1), which 
in turn allowed us to calculate 7. The equality expressed 
in Eq.M. (18) is obtained with high accuracy, as shown 
111 Fig. [5) We can also calculate the LHS and RHS of the 
first moment of our fluctuation theorem [Eq.M. (13a)] in- 
dependently. We again find excellent agreement between 
the two results: see Fig. [6] 
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FIG. 6. Simulation results for (|3 (AE — AF)) (solid blue) 
and the RHS of Eq. (13a) (red dashed) using the Markovian 
master equation and tf = 5 /is, J = 1/2, T = 17mK, and u c = 
8tt. The two curves overlap to within numerical accuracy. 



To compute AF, as needed for Eq.M. (20), the eigen- 
values Si of the initial {i = a) and final (i = /3) Hamil- 
tonian are numerically computed by diagonalizing the 
respective Hamiltonians. In turn, the respective par- 
tition functions are calculated using the energy eigen- 



values found, Z = J^. 
F = -\n{Z)/(3. 



-fa 



The free energy is then 



EXPERIMENTAL SYSTEM 

Our experiments were performed using the D-Wave 
One Rainier chip at the USC Information Sciences In- 
stitute, comprising 16 unit cells of 8 superconducting 
flux qubits each, with a total of 108 functional qubits. 
The couplings are programmable superconducting induc- 
tances. The qubits and unit cell, readout, and control 
have been described in detail elsewhere [55H57] . The ini- 
tial energy scale for the transverse field is 33.7GHz (the 
A function in Fig[7|), the final energy scale for the Ising 
Hamiltonian (the B function) is 33.6GHz, about 15 times 
the experimental temperature of 17mK « 2.3GHz. For a 
given Ising Hamiltonian, the quantum annealing process 
was repeated 50,000 times per qubit pair. We used five 
different qubit pairs to rule out systematic local magnetic 
field bias. As a further precaution against systematic bias 
we applied three spin-inversion transformations to our 
Ising Hamiltonian: Hi sing i-> crj-ff ising for j = 1,2, and 
-Hising l— > &\ erf -ffisingcf cr'f , all of which commute with the 
transverse field component a i °f our system Hamil- 
tonian. These transformations simply relabel the energy 
spectrum, i.e., if a certain spin configuration has energy 
E, then under the transformation <JjHi sing <7j, the con- 



figuration with the j-th spin flipped will also have energy 
E. Averaging the results over the four different isospec- 
tral Ising Hamiltonians and over the five different qubit 
pairs for a given Ising problem, we have a total of 10 6 
data points per given values of J and t f . 

At J = 0, we would expect to find the (excited) states 
| t-j-) an( i I it) w ith equal probability. However, this sym- 
metry is broken in our experimental data. This should 
not be interpreted as being solely due to a local magnetic 
field bias, since averaging over spin-inversion transforma- 
tions should have cancelled any such bias. This suggests 
a more systematic (unaccounted) source of noise in the 
experiment. We found that to fit the experimental data 
in Fig.M. 3 over the full range of Ising couplings J, the 
local magnetic fields in the Ising Hamiltonian needed to 
be adjusted from their ideal value of 1/3 to hi = 0.28 
and h 2 = 0.37. 

The theoretical best fit (in Fig.M. 3) was found by de- 
termining the value of k = g 2 i]/h 2 that minimizes the 
mean square deviation (MSD) between the n experimen- 
tal {(v}Ex,i} and theoretical {(v)tii,i} results: 



MSD(k) 



I ™ 

II — ' 



Ex/. 



MkO)tm) z 



(35) 



i=l 



In principle, the high-frequency cut-off u> c is also a free 
parameter in our theoretical model, and it can also be 
used as part of the fitting parameters. We found that 
choosing a different uj c requires a different optimal k value 
to fit the data, but we restricted ourselves to uj c = 87r 
GHz since it nicely satisfies the approximations made in 
the derivation of the master equation [H] . 




1.0 t 



f 



FIG. 7. The annealing schedules A(t) and B(t) used in the 
system Hamiltonian in the experiment and in our numerical 
simulations. 



